What is claimed is: 



1 . A method for correcting an image frame, the method comprising: 

receiving a first image frame from a digital sensor; 

receiving a plurality of image frames from the digital sensor exposed to light 
5 below a first predefined luminance level; 

receiving a plurality of image frames from the digital sensor exposed to light 

above a second predefined luminance level; and 
correcting the first received image frame based on the received plurality of image 
frames exposed to light below the first predefined luminance level and the 
10 plurality of image frames exposed to light above the second predefined 

luminance level. 

2. The method of Claim 1, wherein each image frame includes a plurality of frame 
units and correcting includes: 

calculating a mean value for each frame unit of the plurality of image frames 
15 exposed to light below the first predefined luminance level; 

calculating a mean value for each frame unit of the plurality of image frames 

exposed to light above the second predefined luminance level; 
generating a second image frame by subtracting the calculated mean value for 
each frame unit of the plurality of image frames exposed to light below the 
20 first predefined luminance level from the corresponding frame unit in the first 

image frame; 

generating a third image frame by subtracting the calculated mean value for each 
frame unit of the plurality of image frames exposed to light below the first 
predefined luminance level from the calculated mean value for each 
25 corresponding frame unit of the plurality of image frames exposed to light 

above the second predefined luminance level; 

generating a fourth image frame by dividing each frame unit in the second image 
frame from the corresponding frame unit in the third image frame; 

calculating an average of frame units within a predefined center section of the 
30 third image frame; and 

generating a fifth image frame by multiplying each frame unit in the fourth image 
frame by the calculated average of the center section frame units, thereby 
producing a corrected image frame of the received image frame. 
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3. The method of Claim 2, wherein generating a fifth image frame includes adding a 
first predefined constant value. 

4. The method of Claim 3, wherein the first constant value is around 150 based on 
sensor testing and characterizations . 

5 5. The method of Claim 1, wherein receiving the image frames includes enhancing the 

image frames based on characteristics of the digital sensor. 

The method of Claim 5, wherein enhancing the image frames includes: 
determining a region of interest based on a masked region of the digital sensor; 
determining a standard deviation of the frame units for the determined region of 
interest; 

determining a threshold value based on the determined standard deviation; 
determining a mean of the frame units in the determined region of interest that are 

below the determined threshold value; and 
generating enhanced image frames based on the determined mean of the frame 
units. 

The method of Claim 6, wherein generating enhanced image frames includes: 
determining a mean difference value based on the determined mean of the frame 

units and a predefined coefficient; and 
adding the determined mean difference value to each frame unit of the 
corresponding image frame. 

The method of Claim 7, wherein determining a mean difference value includes 
subtracting the determined mean of the frame units from 150. 

9. The method of Claim 6, wherein determining a threshold value includes multiplying 
the determined standard deviation by a second constant value. 

25 1 0. The method of Claim 9, wherein the second constant value is around 6. 

11. The method of Claim 5, wherein receiving the first image frame includes removing 
light scattering effects from a portion of the enhanced image frame based upon light 
scattering properties. 
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12. The method of Claim 11, wherein the light scattering properties include light 
scattering effects of the frame units upon all other frame units based upon distance between 
the respective frame units. 



13. The method of Claim 12, wherein removing light scattering effects includes: 
5 a) calculating an average value of frame units within the determined region of 

interest; 

b) generating a second image frame and by removing the calculated average 
value from each of the frame units of the enhanced first image frame; 

c) separating the second image frame into a plurality of subarrays; 

10 d) generating a total for each subarray by adding all the frame units of the 

respective subarray; 

e) determining a distance of a frame unit of the second image frame from one of 
the subarrays; 

f) determining the light scattering effect of the subarray upon the frame unit 
15 based upon the determined distance of the frame unit from the subarray and 

predetermined light scattering characteristics; 

g) generating a subarray light scattering effect by multiplying the determined 
light scattering effect by the generated total of the associated subarray; 

h) repeating e) - g) for all the subarrays; 

20 i) generating a subarray effects total by adding all the generated subarray light 

scattering effects; 

j) generating a final frame unit by subtracting the generated subarray effects 

total from the respective frame unit; and 
k) repeating e) - j) for all the frame units of the second image frame. 

25 14. A system for correcting an image frame produced by a digital sensor, the system 

comprising: 

a processor including: 

a first component configured to receive a first image frame from the 
digital sensor, a plurality of image frames exposed to light below a 
30 first predefined luminance level, and a plurality of image frames 

exposed to light above a second predefined luminance level; and 
a second component configured to correct the first image frame based on 
the received plurality of image frames exposed to light below the first 
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predefined luminance level and the plurality of image frames exposed 
to light above the second predefined luminance level; and 
an output device configured to output the corrected image frame. 



15. The system of Claim 14, wherein each image frame includes a frame unit and 
5 wherein the second component includes: 

a third component configured to calculate a mean value for each frame unit of the 
plurality of image frames exposed to light below the first predefined 
luminance level; 

a fourth component configured to calculate a mean value for each frame unit of 
10 the plurality of image frames exposed to light above the second predefined 

luminance level; 

a fifth component configured to generate a second image frame by subtracting the 
calculated mean value for each frame unit of the plurality of image frames 
exposed to dark from the corresponding frame unit in the first image frame; 

15 a sixth component configured to generate a third image frame by subtracting the 

calculated mean value for each frame unit of the plurality of image frames 
exposed to light below the first predefined luminance level from the 
calculated mean value for each corresponding frame unit of the plurality of 
image frames exposed to light above the second predefined luminance level; 

20 a seventh component configured to generate a fourth image frame by dividing 

each frame unit in the second image frame from the corresponding frame unit 
in the third image frame; 
an eighth component configured to calculate an average of frame units within a 
predefined center section of the third image frame; and 

25 a ninth component configured to generate a fifth image frame by multiplying each 

frame unit in the fourth image frame by the calculated average of the center 
section frame units, thereby producing a corrected image frame of the 
received image frame. 

16. The system of Claim 15, wherein the ninth component includes a tenth component 
30 configured to add a first predefined constant value. 

17. The system of Claim 16, wherein the first constant value is around 150 based on 
sensor testing and characterizations. 



1 2 - Black Lowe & Graham f 



~ - _ BOEl-l-H82AP.doc 

25315 6 Second nuc 



PATENT TRADEMARK OFFICE 



Seattle, Washington 98104 
206.381.3300 • F: 206.381.3301 



18. The system of Claim 14, wherein the first component is configured to enhance the 
image frames based on characteristics of the digital sensor. 



19. The system of Claim 18, wherein the first component is configured to enhance the 
image frames by: 

5 determining a region of interest based on a masked region of the digital sensor; 

determining a standard deviation of the frame units for the determined region of 
interest; 

determining a threshold value based on the determined standard deviation; 
determining a mean of the frame units in the determined region of interest that are 
10 below the determined threshold value; and 

generating enhanced image frames based on the determined mean of the frame 
units. 

20. The system of Claim 19, wherein the first component is configured to generate the 
enhanced image frames by: 

15 determining a mean difference value based on the determined mean of the frame 

units and a predefined coefficient; and 
adding the determined mean difference value to each frame unit of the 
corresponding image frame. 

21. The system of Claim 20, wherein the predefined coefficient is about 150 based on 
20 sensor testing and characterizations. 

22. The system of Claim 19, wherein the first component is configured to determine a 
threshold value by multiplying the determined standard deviation by a second constant value. 

23. The system of Claim 22, wherein the second constant value is around 6. 

24. The system of Claim 18, wherein the first component is configured to remove light 
25 scattering effects from the enhanced image frame based upon light scattering properties. 

25. The system of Claim 24, wherein the light scattering properties include light 
scattering effects of the frame units upon all other frame units based upon the distance 
between the respective frame units. 

26. The system of Claim 25, wherein the third component is configured to remove light 
30 scattering effects by: 
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a) calculating an average value of frame units within the determined region of 
interest; 

b) generating a second image frame by removing the calculated average value 
from each of the frame units of the enhanced first image frame; 

5 c) separating the second image frame into a plurality of subarrays; 

d) generating a total for each subarray by adding frame units of the respective 
subarray; 

e) determining a distance of a frame unit of the second image frame from one of 
the subarrays; 

10 f) determining the light scattering effect of the subarray upon the frame unit 

based upon the determined distance of the frame unit from the subarray and 
predetermined light scattering characteristics; 
g) generating a subarray light scattering effect by multiplying the determined 
light scattering effect by the generated total of the associated subarray; 
15 h) repeating e) - g) for all the subarrays; 

i) generating a subarray effects total by adding all the generated subarray light 
scattering effects; 

j) generating a final frame unit by subtracting the generated subarray effects 
total from the respective frame unit; and 
20 k) repeating e) - j) for all the frame units of the second image frame. 

27. A computer-program product residing on a computer readable medium for 
correcting an image frame produced by a digital sensor, the computer-program product 
comprising: 

a first computer program code component configured to receive a first image 
25 frame from the digital sensor, a plurality of image frames exposed to light 

below a first predefined luminance level, and a plurality of image frames 

exposed to light above a second predefined luminance level; and 
a second computer program code component configured to correct the first image 

frame based on the received plurality of image frames exposed to light below 
30 the first predefined luminance level and the plurality of image frames exposed 

to light above the second predefined luminance level; and 
a third computer program code component configured to output the corrected 

image frame on an output device. 
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28. The computer-program product of Claim 27, wherein each image frame includes a 
frame unit and wherein the second computer program code component includes: 

a fourth computer program code component configured to calculate a mean value 
for each frame unit of the plurality of image frames exposed to light below the 
5 first predefined luminance level; 

a fifth computer program code component configured to calculate a mean value 
for each frame unit of the plurality of image frames exposed to light above the 
second predefined luminance level ; 

a sixth computer program code component configured to generate a second image 
10 frame by subtracting the calculated mean value for each frame unit of the 

plurality of image frames exposed to light below the first predefined 
luminance level from the corresponding frame unit in the first image frame; 

a seventh computer program code component configured to generate a third 
image frame by subtracting the calculated mean value for each frame unit of 
15 the plurality of image frames exposed to light below the first predefined 

luminance level from the calculated mean value for each corresponding frame 
unit of the plurality of image frames exposed to light the second predefined 
luminance level; 

an eighth computer program code component configured to generate a fourth 
20 image frame by dividing each frame unit in the second image frame from the 

corresponding frame unit in the third image frame; 
a ninth computer program code component configured to calculate an average of 

frame units within a predefined center section of the third image frame; and 
a tenth computer program code component configured to generate a fifth image 
25 frame by multiplying each frame unit in the fourth image frame by the 

calculated average of the center section frame units, thereby producing a 
corrected image frame of the received image frame. 

29. The computer-program product of Claim 28, wherein the tenth computer program 
code component includes an eleventh computer program code component configured to add a 

30 first predefined constant value. 

30. The computer-program product of Claim 29, wherein the first constant value is 
around 150 based on sensor testing and characterizations. 
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31. The computer-program product of Claim 27, wherein the first computer program 
code component is configured to enhance the image frames based on characteristics of the 
digital sensor. 

32. The computer-program product of Claim 31, wherein the first computer program 
5 code component is configured to enhance the image frames by: 

determining a region of interest based on a masked region of the digital sensor; 
determining a standard deviation of the frame units for the determined region of 
interest; 

determining a threshold value based on the determined standard deviation; 
10 determining a mean of the frame units in the determined region of interest that are 

below the determined threshold value; and 
generating enhanced image frames based on the determined mean of the frame 
units. 

33. The computer-program product of Claim 32, wherein the first computer program 
15 code component is configured to generate the enhanced image frames by: 

determining a mean difference value based on determined mean of the frame units 

and a predefined coefficient; and 
adding the determined mean difference value to each frame unit of the 

corresponding image frame. 

20 34. The computer-program product of Claim 33, wherein the predefined coefficient is 
about 150 based on sensor testing and characterizations. 

35. The computer-program product of Claim 32, wherein the first computer program 
code component is configured to determine a threshold value by multiplying the determined 
standard deviation by a second constant value. 

25 36. The computer-program product of Claim 35, wherein the second constant value is 

around 6. 

37. The computer-program product of Claim 27, wherein the first computer program is 
further configured to remove light scattering effects from the enhanced image frame based 
upon light scattering properties. 
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38. The computer-program product of Claim 37, wherein the light scattering properties 
include light scattering effects of the frame units upon all other frame units based upon 
distance between the respective frame units. 



39. The computer-program product of Claim 38, wherein the twelfth computer program 
5 code component is configured to remove light scattering effects by: 

a) calculating an average value of frame units within the determined region of 
interest; 

b) generating a second image frame by removing the calculated average value 
from each of the frame units of the enhanced first image frame; 

1 0 c) separating the second image frame into a plurality of subarrays; 

d) generating a total for each subarray by adding frame units of the respective 
subarray; 

e) determining a distance of a frame unit of the second image frame from one of 
the subarrays; 

15 f) determining the light scattering effect of the subarray upon the frame unit 

based upon the determined distance of the frame unit from the subarray and 
predetermined light scattering characteristics; 
g) generating a subarray light scattering effect by multiplying the determined 
light scattering effect by the generated total of the associated subarray; 
20 h) repeating e) - g) for all the subarrays; 

i) generating a subarray effects total by adding all the generated subarray light 
scattering effects; 

j) generating a final frame unit by subtracting the generated subarray effects 
total from the respective frame unit; and 
25 k) repeating e) - j) for all the frame units of the second image frame. 

40. A method for removing light scattering effects from an image frame generated by a 
digital sensor, the method comprising: 

a) receiving a first image frame from the digital sensor; 

b) calculating an average value of frame units within a predetermined region of 
30 interest of the received image frame; 

c) generating a second image frame by removing the calculated average value 
from each of the frame units of the first image frame; 

d) separating the second image frame into a plurality of subarrays; 
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e) generating a total for each subarray by adding frame units of the respective 
subarray; 

f) determining a distance of a subarray from a frame unit; 

g) determining light scattering effects based upon the determined distance and 
5 predetermined light scattering characteristics; 

h) generating a subarray light scattering effect by multiplying the determined 
light scattering effect by the generated total of the associated subarray; 

i) repeating f) - h) for processing all the subarrays; 

j) generating a subarray effects total by adding all the generated subarray light 
10 scattering effects; 

k) generating a final frame unit by subtracting the generated subarray effects 

total from the respective frame unit; and 
1) repeating f) - k) for processing all the frame units of the second image frame. 

41. A system for removing light scattering effects from an image frame generated by a 
1 5 digital sensor, the system comprising: 
a processor including: 

a first component configured to receive a first image frame from the 
digital sensor; a plurality of image frames exposed to light below a 
first predefined luminance level, and a plurality of image frames 
20 exposed to light above a second predefined luminance level; 

a second component configured to calculate an average value of frame 
units within a predetermined region of interest of the first image 
frame; 

a third component configured to generate a second image frame by 
25 removing the calculated average value from each of the frame units of 

the first image frame; 
a fourth component configured to separate the second image frame into a 

plurality of subarrays; 
a fifth component configured to generate a total for each subarray by 
30 adding frame units of the respective subarray; 

a sixth component configured to determine a distance of a frame unit of 

the second image frame from one of the subarrays; 
a seventh component configured to determine the light scattering effect of 

the subarray upon the frame unit based upon the determined distance 
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of the frame unit from the subarray and predetermined light scattering 
characteristics; 

an eighth component configured to generate a subarray light scattering 

effect by multiplying the determined light scattering effect by the 
5 generated total of the associated subarray; 

a ninth component configured to return to the sixth component until all the 

subarrays have been analyzed; 
a tenth component configured to generate a subarray effects total by 

adding all the generated subarray light scattering effects; 
10 an eleventh component configured to generate a final frame unit by 

subtracting the generated subarray effects total from the respective 

frame unit; and 

a twelfth component configured to return to the sixth component for 
processing all the frame units of the second image frame; and 
15 an output device configured to output the result of the twelfth component. 

42. A computer-program product residing on a computer readable medium for 
removing light scattering effects from an image frame generated by a digital sensor, the 
computer-program product comprising: 

a first component configured to receive a first image frame from the digital 
20 sensor; a plurality of image frames exposed to light below a first predefined 

luminance level, and a plurality of image frames exposed to light above a 
second predefined luminance level; 
a second component configured to calculate an average value of frame units 
within a predetermined region of interest of the first image frame; 
25 a third component configured to generate a second image frame by removing the 

calculated average value from each of the frame units of the first image frame; 
a fourth component configured to separate the second image frame into a plurality 
of subarrays; 

a fifth component configured to generate a total for each subarray by adding 
30 frame units of the respective subarray; 

a sixth component configured to determine a distance of a frame unit of the 

second image frame from one of the subarrays; 
a seventh component configured to determine the light scattering effect of the 
subarray upon the frame unit based upon the determined distance of the frame 
35 unit from the subarray and the light scattering effects; 
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an eighth component configured to generate a subarray light scattering effect by 
multiplying the determined light scattering effect by the generated total of the 
associated subarray; 

a ninth component configured to return to the sixth component for all the 
subarrays; 

a tenth component configured to generate a subarray effects total by adding all the 

generated subarray light scattering effects; 
an eleventh component configured to generate a final frame unit by subtracting 

the generated subarray effects total from the respective frame unit; 
a twelfth component configured to return to the sixth component for processing 

all the frame units of the second image frame; and 
a thirteenth component configured to output the result of the twelfth component to 

an output device. 

43. A method for generating an image, the method comprising: 

collecting a digital image of a designated area of the ground from a sensor in an 
airborne vehicle; 

correcting the collected image based on characteristics of the sensor; and 
distributing the correcting image. 
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